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Summary:  Moments  of  the  Minimum  of  a  Random  walk  and  Complete  Convergence 


Let  S  be  a  random  walk  with  positive  drift.  Let  S  =  inf  {S  } .  New 
n  mm  ^  „  n 


proofs  are  given  of  the  following:  For  p  ^  1  Elsmin 

I  p+1  _  .  n  —  r  —  ~  I  2 


n>0 

|P  <  oo  <=> 


E(|S1|P  11(S  <Q))  <  £  P{Sn  <  0}  <  »  <=>  e(Is1M-(si<0))  <  and  S°mC 


1.  Introduction 


This  paper  gives  new  proofs  of  the  equivalences  that  are  stated  as 

Theorem  1  in  Section  3.  Robbins  and  Hsu  [6]  first  showed  c  =>  e  in 

1948  with  p  =  I.  They  considered  the  problem  in  the  context  of  a  ran- 

2 

dom  walk  generated  by  with  E  X^  =  0,  and  showed  that  E  X^  <  ® 

=>  E  p{l— ILL  >  e}  <  oo.  They  called  the  finiteness  of  this  sum  complete  con- 
n  n 

vergence.  It  implies  the  strong  law  of  large  numbers  by  an  application  of 
the  Borel-Cantelli  lemma.  Erdos  [3]  proved  the  reverse  direction  in  1949 
and  Baum  and  Katz  [1]  added  the  equivalence  of  (d)  in  1965.  Kiefer  and 
Wolfowitz  [5]  estiblished  the  equivalence  of  (c)  and  (f)  and  the  (c)<=>(g) 
is  in  Taylor  [7].  Independent  discovery  of  both  of  the  results  were  credited 
by  the  respective  authors  to  unpublished  work  of  Darling,  Erdos  and  Kakutani. 
These  results  are  partially  restated  as  Theorems  2  and  3  of  section  4. 

The  new  proofs  provide  an  e-free  approach  to  these  problems.  The  elemen¬ 
tary  Renewal  Theorem,  time  reversal,  and  Wald's  identities  are  the  primary 
tools,  and  suffice  for  the  case  p=2.  For  larger  p,  the  martingale  con¬ 
ditional  square  function  has  to  be  used  to  replace  Wald's  identities  to  show 
the  existence  of  moments  in  stopped  random  walks. 


2.  Notation  and  Conventions. 

Fix  the  following  notation  and  conventions.  X^  is  an  i.i.d.  se¬ 
quence  with  y  =  EX^  >0;  X  =  -X  ^0  =  ^i  =  ^  Xj  ^or  *  > 

j=1  (j) 

S  =  inf{S  ;  i  >  0};  T  is  the  first  strict  ascending  ladder  epoch,  t  is 

min  i  +  * 

the  jth  strict  ascending  ladder  epoch:  T_  is  the  first  weak  descending  ladder 
epoch,  or  +  *  if  none  exists,  T-^  is  the  jth  weak  descending  ladder 
epoch,  or  +  00  if  none  exists  (see  Feller  [4],  Sec.  12.1  for  definition); 


I 

L 


L(°)  l  1{  f  s  <  0}t  N(0)  E  1{S  <  0}, 

n=l  ..  j  —  n=l  n  — 

i.e.  L(0)  is  the  last  time  the  process  is  non-positive,  and  N(0)  is  the 

number  of  times  the  process  is  non-positive;  inf{  }  =  °°;  x(a)  = 

inf {n  >0:  S  >  a};  t(a)  =  inf{n  >0:  S  <  a};  K  and  C  will  be  posi- 
n  —  n  — 

tive  constants,  not  necessarily  the  same  from  line  to  line;  E{Y;A}  = 

E(Y1, ) ;  w  =  (X.,X,,...),  =  (X  X  EX  denotes  expectation  of 

A  -L  z  a  a+i ,  a+z 

the  random  walk  started  from  x;  E  =  E°. 

3.  Statement  and  Proof  of  Theorem: 


Theorem  1:  For  p  >  2  the  following  are  equivalent: 

a) .  E(t+P)  <  °° 

b)  .  E(t_P  S  T_  <  °°)  <  °° 

c) .  E((X~)P)  <  oo 

d) .  E(L(0)P_1)  <  oo 

e) .  E(N(0)p_1)  <  oo 

f) .  E(  |  S  .  |P_1)  <  «» 

1  mm 1 

g) .  E(|St_|P  1 ;  T_  <  oo)  <  oo. 

Four  lemmas  will  be  given  first,  then  the  proof  proceeds  as  follows: 
a  <=>  b;  a  <=>  c;  d  =>  b;  a  and  b  =>  d;  d  =>  e;  e  =>  g;  g  -  >  f;  f  =>  e; 
f  =>  c . 


Lemma  1:  If  E(t+h)  <  oo  then  £(t(-x)p  ;  t(-x)  <  oo)  <  k  V  x  >  0. 
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Proof:  By  time-reversal  one  has,  V  K  >  0, 

P{t(-K)  -  n}  =  P{S.  >  .  >  -K,  S  <  -K} 

l  n— l  n 

*  P{S  -  S  ,  >  -  K . S  -  S.  >  -K,  S  <  -K} 

n  n-1  n  i  n 

<  P{S,  <  0 . S  <  0} 

—  i  n 

=  P{t+  >  n}. 

Multiply  the  first  and  ]ast  lines  by  nP  ^  and  summing  implies  the  result, 

with  K  *  C  E(r  P). 

P  + 

Lemma  2:  If  E(t+P)  <  «  then  E(T(y)P)<  K(y  +  1)P  V  y  >  0. 

Proof :  First  notice  that  E(T+P)  <  ~  =>  E(x(y)P)  <  «  ,V  y  >  0,  For 
if  P{X  <  0}  >  0  one  conditions  on  the  random  walk  at  time  1  to  show 
E(t(e)P)  <  °°,  3  e  >  0,  from  which  E(T(y)P)  <  00  Vy  follows  as  below, 
if  P{X  <  0}  *  0  the  one-sided  hitting  problem  is  the  same  as  a  two-sided 
problem,  for  which  Stein's  Lemma  (cf  Feller  [5],  Sec.  18.2)  says  t(y) 
has  moments  of  all  orders.  To  proceed  with  the  proof,  observe  that  for 
K  >  0  an  integer 

T(Ky)  <_  T(y)  +  T(y)(u)TJ))  +  ...  +  T(y)  (</(  } )  and  the 

x(y)(o)^jyj)  are  l.i.d.  Hence  by  Minkowski's  Inequality. 

E(T(Ky)P)  <  KP  E(T(y)P) 

and  so 
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E(T(y)P)  <  E  T([y]  +  1)P 


<  E(T(l)P)([y]  +  1)P 


<  E(r(l)P) (y  +  1)P 


Lemma  3:  For  x  >  0  let 


R-x  *  -St(-x>  -X  •  t(-x)  ' 


,  t(-x)  =  «. 


Then  V  p  >  1  E((X~)P)  <  “  =>  E(R  P  1;  t(-x)  <  <»)  <  K,  where  K  is 


independent  of  x. 


Proof ;  This  is  essentially  the  same  as  Theorem  2.4  in  Woodroofe  [8] 


P{R_  >  y}  =  Z  P{t(-x)  _>  n,  S  <  -x  -  y}. 
n=l 


<  Z  P{S  >  -x,  S  <  -x  -  y} 
—  ,  n-1  —  n 

n=l 


=  Z  /  F(-x  -  y  -  s)  F 

n-1  'x 


=  /  F(-x  -  y  -  s)U  (ds) 


<_C  Z  F (-x  -  y  -  k) 
k>-x 


<  C  Z  F(-y  -  k) 
k>0 


i  C  J~_l  F(z)dz. 


*(n-l) ; 
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where  F  J  is  the  j-fold  convolution  of  F  with  itself,  and  U  is  the 

renewal  measure:  U(x)  -U(y)  =  Z  [F  m(x)  -  F  m(y)].  Multiplying  the  first 

2  111=0 

and  last  statements  by  yp  and  integrating  gives  the  stated  result. 


Lemma  4 


l  £(|StJP;  t-  <  oo)  <  oo  =>  E^X")1*1)  <  ®  V  p  >  0. 


Proof:  The  statement  is  invariant  under  change  of  scale,  so  if  X  is 

lattice  one  may  assume  that  the  span  of  X  is  less  than  1.  It  may  also 
be  assumed  that  X  is  not  bounded  below,  for  otherwise  the  statement  of 
the  lemma  is  trivial.  In  this  case,  with 


R  =  S  ,  .  ~  x  , 
x  T(x)  * 


since  the  asymptotic  distribution  of  has  positive  mass  on  [0,1)  (see 

Woodroofe  [8],  Sec.  2.2), 

0  <  r  =  inf  P{R  <  l}. 
x>0  X 


By  time-reversal,  for  n  _>  0 


P(S  e  (-n  -  1,  -n),  T-  <  »} 
x- 


=  Z  P{S  >  0,...,S  >  0,  S.  £  (-n  -  1,  -n)> 

j=l  J  J 

'  ^  p{sj  >  si . sj  P  si-r  si  E  <_n  '  11  ■n>,• 

OO 

_>  Z  P{-n  -  1  >  S  ,...,-n  -  1  >  S  ,  S  e  (-n  -  1,  -n)> 
j=l  3 


r  =  j.  R_n_1  <  1} 

j'1 


P{R  n  <  1}. 
-n-l 
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P{R_n_^  <  1}  >  <  1,  X1  <  -n  -  1} 

=  /°° 1 1  P{R  n  <  1}  P{x7  e  dx}, 
Jn+1  x-n-1  1 


>_  r  P{x~  >  n  +  1}. 


P{St_  e  (-n  -  1,  -n)}  >_  r  P{X1  _>  n  +  l}. 


Multiplying  by  np  and  summing  gives  the  statement  of  the  lemma. 


Proof  of  the  Theorem. 

a  =>  b  E(TP)  <  0°  =>  E(tP  t  <  <»)  <  <»,  By  a  standard  time 
reversal  argument  (See  Feller  [4],  Sec.  12.2), 

CO 

P{x  >  n}  =  Z  P{t^  =  n). 

j=l 

In  particular 

P{t+  >  n}  _>  P{t_  =  n} . 

Multiplying  by  nP  ^  and  summing  gives  the  result. 


b  =>  a  E(tP  ;  T  <  ■»)  <  oo  =>  F,(lP)  <  °°.  Note  that  conditioned 

or.  <  00  =  Y.  Y.,  where  the  Y.  are  i.i.d.  with 

i  =  l  1  1 
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w  /  *  \ 

P{Y  <  y}  =  P{t  <  y  |  T  <  °°}.  Thus  I  nP  P{t  =  n}  = 

1  "  m=l 

E(|t^^|P-1;  <  «)  <  jp-1  E(tp_1  [  t_  <  “»)  P{x_  <  «}J 

So 

Z  nP_1  P{x  >  n}  <  l  jP_1  P{T_  <  oo}^"1  E(tP_1;  t_  <  °°) 
m=l  j=l 

<  K  EOr^"1;  t_  <  °°). 
a  =>  c  E(TP)  <  «<•  ->  E( (X~)P)  < 

By  the  Elementary  Renewal  Theorem  (Chung  [9],  Thm.  5.5.2),  3  c,  K  >  0  such 
that  E(T (x) )  >  cx  V  x  >  K.  So  E(T(x)P)  _>  (E(t(x)))P  >_  cP  xP  V  x  >  K 
Conditioning  on  the  first  step  of  the  random  walk  gives 

o°  >  E(tP) 

>_  /”  E(T(x))P  P{X  e  dx}. 

>  /"  cP  xP  P{X~  e  dx}. 

■  JA. 

The  last  line  implies  E((X  )P)  <  00 . 

c  =>  a  £( (X~)P)  <  oo  =>  E(tP)  <  oo.  it  suffices  to  assume  X  <_  c 

c  >  0;  for,  Xt  can  be  truncated  above  to  give  X^^  with  E  X^  >  0, 
and  T  for  the  random  walk  generated  by  the  is  larger  than  that  for 
the  random  walk,  so  if  the  claim  can  be  proven  for  the  K±  process 

it  follows  for  the  Xi  process. 

In  this  case  it  may  be  assumed  that  the  X^  have  at  least  2  moments. 
Wald’s  identity  for  the  2nd  moment  gives 


for  some 
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E(SX  -  y  T+)2  =  (Var  X±)  E(T+) 

2  2 

But  <  c  so  E  <  00  =>  E  T+  <  00 .  Let 

E((X  )q)  <  «>  =>  E(T+q)  <»V  2<_q<^p}.  Suppose 


<  OO, 


q  =  sup{p  >_  2 : 


q  <  00 .  Let  q  <  q  <  2q. 


Then 


<  OO, 


Therefore,  by  Burkholder  and  Gundy  [2],  Theorem  5.3. 


E  I  ST  -  M  T+  jq  <  00 

from  which  E  tq  <  00  follows  as  above.  This  is  a  contradiction. 

d  =>  b  E(L(0)P_1)  <  oo  =>  E(T_P_1;  T_  <  oo)  <  oo. 

Proof!  L(0)  >  T_1{t  < 

a  and  b  =>  d  E(tP)  <  oo,  and  E(t  P  x  <  oo)  <  oo  =>  e(L(0)P  <  oo. 


The  idea  of  the  proof  is  to  express  L(0)  as  a  sum  of  successive  trips 

above  and  below  the  origin,  until  the  random  walk  stays  permanently  above 

s  t 

0.  Finding  the  random  walk  above  0  one  must  know  the  p-1  moment  of  the 

expected  time  to  get  back  below  0  must  be  bounded  no  matter  where  the 

process  is,  provided  it  ever  does.  This  is  the  content  of  Lemma  1.  Having 

s  t 

hit  below  0  one  must  know  that  the  p-1  moment  of  the  expected  time 
to  reach  0  is  finite.  According  to  Lemma  2  this  quantity  is  bounded  by 
K  /”  ( | y [  +  l)p-1  F(dy),  where  F  denotes  the  hitting  place  of  the  non¬ 
positive  axis. 
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Lemma  3  provides  a  uniform  bound  on  the  p-1  moments  of  these  distri¬ 
butions  F.  The  proof  is  then  finished  by  observing  that,  because  of  the 
positive  drift,  this  cycling  behavior  can  only  be  repeated  a  few  times. 


Proof;  Set  p  =  (1-q)  =  P{t  =  ®} .  Define 


T.  =  inf {K  >  1:  Sv  >  0  and  a  m  <  K  with  S  <  0  , 

1  ~  K.  Hi 


and  for  n  >  1 


r  =  inf {K  >  T,  +...+  T  ,  =  S„  >  0  and  3  T  +. . .+  T  <  m  <  K  with 
n  1  n-i  K.  -L  nr 


S  <  0}  -  (T.  +  ...+  T  .),  T  < 
m  —  1  n-1  n-1 


=  00  T  =00 

’  n-1 


[3.1] 


|L(0) |p_1  <  Z  |T1  +  . . .+  Tn|P_1  1 


m=l 


{ T  T 

n<°°,  n+l=°°} 


E(|T  +.  .  .-f  T  |P_1;  T  ,  T  ) 

1  1  n1  n<°°  n+l=°° 

-E(|T1  +<--+  Tn|P_1;  Tn<°°) 

<  nP_1  E(TP-1  +  ...+  TP_1 ;  T  ) 

—  1  n  n  <  00 

E(TP  T  ^  )  is  estimated  seperately  when  i=n,  and  i<n.  First 

i  n  <  00 

the  case  i<n. 

1  n-1 

'  T"-!  '  "  PtT"  <  ”|3T,  +...+  T  Vl  <  “> 

1  n-1 

<  q  E(TP_1 ;  T  <  »)  (*) 

—  1  n-i 


and 
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c 


! 

« 

X 

is 

r 

* 

i 

;< 

4 

I 


E(TP_1;  T  <  °°)  =  E(E(TP_1; 
n  n  n 


T  <  08  .  ,  T  )) 

n  T,  +. . .+  1  , 

1  n-I 


=  E(E 


T1  +. . .+ 


<  °°); 


t  ,  < 

n-l 


°)  . 


Consider  for  x  >  0 

ex{tp_1;  t  <  «}  =  ex{(t_  +  x(-sT_)(^))p"1;  T_  <  “) 

s  -i 

£  2P_1(EX(TP_1;  T_  <  “)  +  EX(E  T“(x(0)P~  ; 

The  first  term  is  <  K  by  Lemma  1.  For  the  2™*,  using  lemmas 
it  follows  that 

S  1 

E  (E  (T(0)P  ;  T_  <  «)) 

=  J°  Ey(T(0)P_1)  PX{Sx_  r.  dy,  T_  <  «} 

—CO 

<  k'  J°  Jy  +  l|p_1  PX{ST_  e  dy,  t_  <  °°) . 

-00 

<_  K". 

Thus 

E(TP_1 :  T  <  °o)  <  K  P{T  <  °°} 
n  n  —  n-X 

£  K  q11"1.  (**)  • 

Set  a  =  E(TP_1  +.  . .+  TP"S  T  <  »)  • 
n  1  n  n 

Summing  (*)  from  1  to  n-l  and  adding  (**)  gives 

„  n-l 

a  <  q  a  +  K  q 
n  —  n-l  1 
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T  <«>)). 

!  and  3 


I 


Therefore,  an  is  geometrically  decreasing,  and  Z  an  <  ®.  A  look 

at  3.1  shows  that  Z  a  <  ”  =>  E  L(O)*1  ^ 

n 

d  =>  e  E(L(0)P_1)  <  «  =>  E(N(0)p_1)  <  » 

Proof;  L(0)  >  N(0) . 

e  =>  g  E(N(0)P_1)  <  oo  =>  E(|S  | P_1;  t_  <  »)  <  °o 

Proof;  The  amount  of  time  spent  getting  back  above  $  after  having  hit 
below  for  the  first  time  is  t(0)(o)*  )  1^  <<»}  •  So 

(1  +  NCO))15'1  >  t(0)(o£  )  1{t  <oo}. 

and  00  >  E((l  +  N(0))p  1)  ^  E(tp  1(0)(o>^  );  T_  <  °°) 

=  E(E(tp_1(0)(u)+  );  t_  <  ooj  Fx  ) 

ST_ 

=  E(E  (t(0)P  ;  T_  <  °°)  “>  E(  |ST  |P  ;  T_  <  oo)  <00 

as  in  the  last  part  of  a  and  b  =>  d. 

R  — >  f  E(  |S  |P  1;  T_  <  oo)  <  00  =>  E(  I  Sm:Ln  1 P_ 1  <  oo) 

Proof:  S  can  be  written  as  Z  ,  where  Z,  is  a  random  walk  with 
-  min  n  i 

P{Z  <  y}  =  P(ST  <  y }  1  T_  <  0°},  P{M  =  n)  =  P{t_  <  °^n  P{t_  =  °o},  n=0, 

1,  •••,  and  M  is  independent  of  the  Z^.  This  can  be  seen  intuitively 
by  considering  the  decreasing  ladder  process,  or  a  quick  proof  can  be 
based  on  a  comparison  of  the  characteristic  functions  given  in  Feller 
[4],  Chapt.  18.  E(  |St  |P  T_  <  oo)  <  oo  =>  g(  | Z^  | P  1)  <  oof  so 

E( I Smin  ^  P_1>  =  1  E(IZJP-1)  p{M  = 
n 

<  E(|Z1|P-1)  Z  nP_1  p{M  =  n) 
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OO 


zLSl  E(lsminlP"1><  00  =>  E{lsx  lp  Xs  <  00}  < 


Proof:  S_  1 r  ,  i  <  Is  .  I 

-  I  T  IJ{T-  <  oo}  _  I  mini 


f  =>  e  E(|S  |P_1)  <  oo  =>  E(N(0)P_1)  < 


Proof:  Since  E(|S  .  |P  then  E{  I S  |P  x  <  co}  <  co  . 

-  1  mm1  1  X-1  - 

lemma  4  E((X  )P+^)  <  00  so  the  result  follows  from  c  ■>  d  =>  e. 
L=>JS.  E(|S  .  |P_1)<  oo  =>  E((x‘)P)  <  00 


Proof:  Follows  from  f  =>  g  and  Lemma  4. 


4.  Remarks  and  Applications. 


Let  be  a  i.i.d.  sequence  of  random  variables  with  EY^  =  0. 

Let  S  =  Y,  +.. .+  Y 
n  1  n 


l(E)  '  nf1  ‘{sup  >  C)  , 


N(e)  =  E  1 r | S 


n  |  >  e}  . 


Theorem  2 :  For  p  _>  2 

(1)  E((N(e)  P_1)  <  oo  <=>  EC  | Y [ p)  <  oo 

(2)  E(L(e)P_l)<  oo  <=>  E (  | Y | p )  <  oo 

°°  |S-  I  9 

(3)  E  P{sup  '-J-1  >  c}  •  nP  <  oo  <=> 
n=l  pn  3 

00  i  S  i 

(4)  E  P{  '  — 1  >  e)  <=>  E  |  Y | 2  <  °o. 

n=l 


E  Y  K  <  oo 
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Remarks :  The  "only  if"  part  of  (4),  for  p=l  is  due  to  Robbins  and  Hsu 
[6]>  (4)  with  p=l  is  due  to  Erdos  [3],  (3)  was  first  proved  by  Baum 
and  Katz  and  can  be  found  in  [1]. 


Proof :  (1)  and  (2)  follow  from  the  equivalence  of  c,d. 


considering  the  random  walks  S  +  ne.  (3)  is  the  same  as 

n  _  s 

observation  that  P{L(£)  >  n}  =  P{sup  >  e},  and  (4) 

i>n  3 

from  (1). 


and  e  by 
(2)  plus  the 
follows  similarly 


Let  be  i.i.d.  random  variables  with  E  X.  =  y  e  (0,°°), 

S  =  X,  +. . .+  X  . 
n  1  n 


Theorem  3:  For  p  _>  1  the  following  are  equivalent: 

(1)  E((X~)P+1)  <  - 

(2)  E(|SX  | P ;  x_  <  oo)  <  « 

(3)  E(|SmlJP)  < 


Remark:  The  equivalence  of  (2)  and  (3)  for  p=l  is  credited  by 
Taylor  [7],  to  unpublished  work  of  Darling,  Erdos  and  Kakutani,  and 
Taylor  adds  a  proof  of  the  equivalence  of  (1).  Kiefer  and  Wolfowitz  [5] 
also  credit  the  equivalence  of  (1)  and  (3)  to  unpublished  results  of 
Darling,  Erdos  and  Kalutani;  and  they  give  their  own  proof.  The  moments  of 
the  minimum  are  of  interest  because  the  minimum  has  the  distribution  of  the 
stationary  distribution  of  a  type  of  queueing  proeess.  See  [4]  p.  198. 

Proof :  This  is  the  equivalence  above,  however,  the  tortuous  path  via 
the  implications  of  Theorem  1  can  be  replaced  by  lemma  4. 


I  would  like  to  thank  Professor  Siegtnund  for  help  received  on  this 
problem.  In  particular  he  showed  me  the  time-reversal  proof  of  b  =>  a. 
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